The maximum mutual information between the output of a binary symmetric channel and a Boolean function of its input

نویسنده

  • Septimia Sarbu
چکیده

We prove the Courtade-Kumar conjecture, which states that the mutual information between any Boolean function of an n-dimensional vector of independent and identically distributed inputs to a memoryless binary symmetric channel and the corresponding vector of outputs is upper-bounded by 1 − H(p), where H(p) represents the binary entropy function. That is, let X = [X1 . . . Xn] be a vector of independent and identically distributed Bernoulli( 1 2 ) random variables, which are the input to a memoryless binary symmetric channel, with the error probability equal to 0 ≤ p ≤ 1 2 , and Y = [Y1 . . . Yn] the corresponding output. Let f : {0, 1} → {0, 1} be an n-dimensional Boolean function. Then, MI(f(X),Y) ≤ 1 − H(p). We provide the proof for the most general case of the conjecture, that is for any n-dimensional Boolean function f and for any value of the error probability of the binary symmetric channel, 0 ≤ p ≤ 1 2 . Our proof employs only basic concepts from information theory, probability theory and transformations of random variables and vectors.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The maximum mutual information between the output of a discrete symmetric channel and several classes of Boolean functions of its input

We prove the Courtade-Kumar conjecture, for several classes of n-dimensional Boolean functions, for all n ≥ 2 and for all values of the error probability of the binary symmetric channel, 0 ≤ p ≤ 1 2 . This conjecture states that the mutual information between any Boolean function of an n-dimensional vector of independent and identically distributed inputs to a memoryless binary symmetric channe...

متن کامل

On the Courtade-Kumar conjecture for certain classes of Boolean functions

We prove the Courtade-Kumar conjecture, for certain classes of n-dimensional Boolean functions, ∀n ≥ 2 and for all values of the error probability of the binary symmetric channel, ∀0 ≤ p ≤ 1 2 . Let X = [X1 . . . Xn] be a vector of independent and identically distributed Bernoulli( 1 2 ) random variables, which are the input to a memoryless binary symmetric channel, with the error probability i...

متن کامل

How to quantize n outputs of a binary symmetric channel to n - 1 bits?

Suppose that Y n is obtained by observing a uniform Bernoulli random vector X through a binary symmetric channel with crossover probability α. The “most informative Boolean function” conjecture postulates that the maximal mutual information between Y n and any Boolean function b(X) is attained by a dictator function. In this paper, we consider the “complementary” case in which the Boolean funct...

متن کامل

Taylor Expansion for the Entropy Rate of Hidden Markov Chains

We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...

متن کامل

Thermodynamic derivation of the mutual information for discrete symmetric channels

Abstract The mutual information for the binary symmetric channel as well as for the discrete symmetric channel consisting of 4-input/output (I/O) symbols is explicitly calculated using the generalized second law of thermodynamics which was recently proposed by the first two authors. For equiprobable I/O the mutual information of the examined channels has a very simple thermodynamic form as a fu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1604.05113  شماره 

صفحات  -

تاریخ انتشار 2016